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(54) Produce recognition system employing sound circuitry 

(57) A produce recognition system which employs 
sound circuitry to convert analog produce data from a 
produce data collector to digital produce data. The 
sound circuitry is controlled by a computer and includes 
an analog-to-digital converter. |" 
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Description 

[0001] The present invention relates to product 
checkout devices and more specifically to a produce 
recognition system which employs sound circuitry. 
[0002] Bar code readers are well known for their 
usefulness in retail checkout and inventory control. Bar 
code readers are capable of identifying and recording 
most items during a typical transaction since most items 
are labeled with bar codes. 

[0003] Items which are typically not identified and 
recorded by a bar code reader are produce items, since 
produce items are typically not labeled with bar codes. 
Bar code readers may include a scale for weighing pro- 
duce items to assist in determining the price of such 
items. But identification of produce items is still a task 
for the checkout operator, who must identify a produce 
item and then manually enter an item identification 
code. Operator identification methods are slow and inef- 
ficient because they typically involve a visual compari- 
son of a produce item with pictures of produce items. 
Operator identification methods are also prone to error, 
on the order of fifteen percent. 

[0004] In order for a computer to identify produce 
items, the computer must obtain digital produce data. 
This digital data may be received from a produce data 
collector through a serial port in the computer, but serial 
ports in transaction processing computers are limited. 
[0005] Sound or audio cards typically employ ana- 
log-to-digital (A/D) converters for converting analog 
sound signals to digital signals for processing and/or 
storage in a computer as digital files. Sound cards are 
typically standard equipment in computers sold today 
and the methods of programming them are well known. 
[0006] Therefore, it would be desirable to provide a 
produce recognition system which employs an A/D con- 
verter, such as one found on a sound card, to produce 
digital produce data. 

[0007] In accordance with a first teaching of the 
present invention, a produce recognition system which 
employs sound circuitry is provided. The system 
includes a produce data collector for collecting produce 
data from a produce item, and a computer including 
sound circuitry coupled to the produce data collector for 
sampling the produce data from the produce data col- 
lector. The computer identifies the produce item from 
sampled produce data. 

[0008] In a preferred embodiment, the produce data 
collector couples to a line input jack of the sound cir- 
cuitry using an audio cable. 

[0009] From a further aspect, the invention also 
resides in a produce recognition method including the 
steps of collecting analog produce data from a produce 
item by a produce data collector, converting the analog 
produce data into digital produce data by an analog-to- 
digital converter within sound circuitry controlled by a 
computer, and identifying the produce item from the dig- 
ital produce data by the computer. 



[0010] The cost of a produce data collector is 
reduced by sharing an A/D converter used for another 
purpose, such as sound recording, to digitize produce 
data rather than incorporating an A/D converter into the 

5 produce data collector. 

[0011] Additional benefits and advantages of the 
present invention will become apparent to those skilled 
in the art to which this invention relates from the subse- 
quent description of the preferred embodiments and the 

w appended claims, taken in conjunction with the accom- 
panying drawings, in which: 

Fig. 1 is a block diagram of a transaction processing 
system including a produce data collector; 
15 Fig. 2 is a block diagram of the produce data collec- 

tor; and 

Fig. 3 is a combinational view showing connection 
of the produce data collector to sound circuitry. 

20 [0012] Referring now to Fig. 1, transaction process- 
ing system 10 includes bar code data collector 12, pro- 
duce data collector 14, and scale 16. 
[001 3] Bar code data collector 1 2 reads bar code 22 
on merchandise item 32 to obtain an item identification 

25 number, also known as a price look-up (PLU) number, 
associated with item 32. Bar code data collector 1 2 may 
be any bar code data collector, including an optical bar 
code scanner which uses laser beams to read bar 
codes. Bar code data collector 12 may be located within 

30 a checkout counter or mounted on top of a checkout 
counter. 

[0014] Produce data collector 14 collects data for 
produce item 18 or any other non-barcoded merchan- 
dise item. Such data may include color and color distri- 

35 bution data, size data, shape data, and aromatic data. 
Reference produce data is collected and stored within 
produce data file 30. During a transaction, operation of 
produce data collector 14 may be initiated by placement 
of produce item 18 on scale 16 or in by operator-initi- 

40 ated commands from transaction terminal 20. 

[0015] Scale 16 determines a weight for produce 
item 18. Scale 16 works in connection with bar code 
data collector 12, but may be designed to operate and 
be mounted separately. Scale 1 6 sends weight informa- 

45 tion for produce item 18 to transaction terminal 20 so 
that transaction terminal 20 can determine a price for 
produce item 18 based upon the weight information. 
[001 6] Bar code data collector 1 2 and produce data 
collector 14 operate separately from each other, but 

50 may be integrated together. Bar code data collector 12 
works in conjunction with transaction terminal 20 and 
transaction server 24. 

[0017] Transaction terminal 20 includes sound cir- 
cuitry 38, which includes waveform sampling circuitry 
55 34. 

[0018] Waveform sampling circuitry 34 includes 
analog-to-digital (A/D) converter 36. Under the present 
invention, waveform sampling circuitry 34 provides both 
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sound processing and produce waveform sampling 
functions. A sixteen-bit A/D converter with a sampling 
rate of 22-44kHz found in common sound circuitry pro- 
duces acceptable results. 

[0019] Sound circuitry 38 is preferably integrated 
into transaction terminal 20 as part of circuit board or 
card, which may be an add-in sound adapter circuit 
board, a mother board having onboard sound process- 
ing circuitry, or a PC card (such as a PCMCIA card). 
Sound circuitry from Creative Labs, Inc., is appropriate 
for this use. Preferably, produce data collector 14 cou- 
ples to an unamplified line input jack 94 (Fig. 3) of the 
sound card or mother board. Though standard line input 
sound circuitry includes two channels (stereo) for 
sound, only one channel need be used for produce 
waveform sampling. 

[0020] Transaction terminal 20 executes waveform 
sampling software 39 which controls sampling by wave- 
form sampling circuitry 34. Waveform sampling soft- 
ware 39 uses standard input-output (I/O) instructions to 
control sampling by A/D converter 34. Advantageously, 
use of sound circuitry 38 avoids finding and configuring 
a free serial port in transaction terminal 20. 
[0021] Transaction terminal 20 also executes pro- 
duce recognition software 21 which compares digitized 
produce data from waveform sampling software 39 with 
reference produce data in produce data file 30. 
[0022] In the case of bar coded items, transaction 
terminal 20 obtains the item identification number from 
bar code data collector 12 and retrieves a correspond- 
ing price from PLU data file 28 through transaction 
server 24. 

[0023] In the case of non-bar coded produce items, 
transaction terminal 20 executes produce recognition 
software 21 which executes waveform sampling soft- 
ware 39. Waveform sampling software 39 converts ana- 
log waveform signals from produce data collector 14 to 
digital signals and returns the digital signals to produce 
recognition software 21. Produce recognition software 
21 identifies produce item 18 by comparing produce 
data in produce data file 30 with collected produce data, 
retrieves an item identification number from produce 
data file 30 and a corresponding price from PLU data 
file 28. 

[0024] PLU data file 28 and produce data file 30 are 
stored within storage medium 26, but either may also be 
located instead at transaction terminal 20, or bar code 
data collector 12. 

[0025] To assist in proper identification of produce 
items, produce recognition software 21 may additionally 
display candidate produce items for operator verifica- 
tion. Produce recognition software 21 preferably 
arranges the candidate produce items in terms of prob- 
ability of match and displays them as text and/or color 
images on an operator display of transaction terminal 
20. The operator may accept the most likely candidate 
returned by or override it with a different choice. 
[0026] Turning now to Fig. 2, one type of produce 



data collector 14 is shown, although other produce data 
collectors which produce analog data signals are also 
envisioned by the present invention. 
[0027] Produce data collector 14 primarily includes 
5 light source 40, spectrometer 51, control circuitry 56, 
transparent window 60, auxiliary transparent window 
61 , and housing 62. 

[0028] Light source 40 produces light 72. Light 
source 40 preferably produces a white light spectral dis- 
10 tribution, and preferably has a range from four hundred 
400nm to 700nm, which corresponds to the visible 
wavelength region of light. 

[0029] Light source 40 preferably includes one or 
more light emitting diodes (LEDs). A broad-spectrum 

15 white light producing LED, such as the one manufac- 
tured by Nichia Chemical Industries, Ltd., is preferably 
employed because of its long life, low power consump- 
tion, fast turn-on time, low operating temperature, good 
directivity. Alternate embodiments may include addi- 

20 tional LEDs having different colors in narrower wave- 
length ranges and which are preferably used in 
combination with the broad-spectrum white light LED to 
even out variations in the spectral distribution and sup- 
plement the spectrum of the broad-spectrum white light 

25 LED. 

[0030] Spectrometer 51 includes light separating 
element 52, photodetector array 54. 
[0031] Light separating element 52 splits light 74 
into light 80 of a continuous band of wavelengths. Light 

30 separating element 52 is preferably a linear variable fil- 
ter (LVF), such as the one manufactured Optical Coat- 
ing Laboratory, Inc., or may be any other functionally 
equivalent component, such as a prism or a grating. 
[0032] Photodetector array 54 is coupled to wave- 

35 form sampling circuitry 34 in transaction terminal 20. 
Photodetector array 54 produces analog waveform sig- 
nals 82 containing spectral data. The pixels of the array 
spatially sample the continuous band of wavelengths 
produced by light separating element 52, and produce a 

40 set of discrete analog signal levels. Photodetector array 
54 is preferably a complimentary metal oxide semicon- 
ductor (CMOS) array, but could be a Charge Coupled 
Device (CCD) array. 

[0033] Control circuitry 56 controls operation of pro- 
45 duce data collector 14. Control circuitry 56 controls the 
output of light source 40 to achieve a smooth and con- 
sistent light pattern. 

[0034] Housing 62 contains light source 40, light 
separating element 52, photodetector array 54, control 

so circuitry 56, and auxiliary transparent window 61 . Hous- 
ing 62 additionally contains transparent window 60 
when produce data collector 14 is a self-contained unit. 
When produce data collector 14 is mounted within the 
housing of a combination bar code reader and scale, 

55 window 60 may be located in a scale weigh plate 
instead. 

[0035] Transparent window 60 is mounted above 
auxiliary transparent window 61. Windows 60 and 61 
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include an anti-reflective surface coating to prevent light 
72 reflected from windows 60 and 61 from contaminat- 
ing reflected light 74. 

[0036] In operation, an operator places produce 
item 18 on window 60. Light source 40 illuminates pro- 5 
duce item 18 with light 72. Light separating element 52 
separates reflected light 74 into different wavelengths to 
produce light 80 of a continuous band of wavelengths. 
Photodetector array 54 produces analog waveform sig- 
nals 82 containing produce data which it sends to trans- 10 
action terminal 20. 

[0037] Transaction terminal 20 executes produce 
recognition software 21 which executes waveform sam- 
pling software 39. Waveform sampling software 39 con- 
verts analog waveform signals 82 from photodetector 15 
array 54 into digital signals. Produce recognition soft- 
ware 21 uses produce data in the digitized signals to 
identify produce item 18. Produce recognition software 
21 compares the produce data to a library of digitized 
waveforms stored within produce data file 30. After 20 
identification, transaction terminal 20 obtains a unit 
price from PLU data file 28 and a weight from scale 16 
in order to calculate a total cost of produce item 18. 
Transaction terminal 20 enters the total cost into the 
transaction. 25 
[0038] With reference to Fig. 3, photodetector array 
54 is mounted to printed circuit board 90 within produce 
data collector 14. Photodetector array 54 provides ana- 
log waveform signals through output terminal 96. 
[0039] Sound circuitry 38 is shown as an adapter 30 
card 97 which connects to a system bus within terminal 
20. Waveform sampling circuitry 34 is mounted to 
adapter card 97. Waveform sampling circuitry 34 
receives analog waveform signals through line input ter- 
minal 94. 35 
[0040] A standard audio cable 92 with standard 
input and output connectors 98 and 1 00 may be used to 
connect output terminal 96 of produce data collector 14 
to line input terminal 94 of sound circuitry 38. If audio 
cable 92 is a stereo audio cable, only one channel is 40 
needed and used. 

[0041] Advantageously, use of sound circuitry 38 to 
provide waveform sampling circuitry 34 avoids the cost 
of adding sampling circuitry to produce data collector 1 4 
and having to send digitized produce data to terminal 20 45 
through a serial port. 

[0042] Although the invention has been described 
with particular reference to certain preferred embodi- 
ments thereof, variations and modifications of the 
present invention can be effected within the spirit and 50 
scope of the following claims. 

Claims 

1. A produce recognition system characterized by: 55 

a produce data collector for collecting produce 
data from a produce item; and 
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a computer including sound circuitry coupled to 
the produce data collector for sampling the pro- 
duce data from the produce data collector; 
wherein the computer identifies the produce 
item from sampled produce data. 

2. The produce recognition system according to claim 
1, wherein the sound circuitry comprises: 

an analog-to-digital converter which converts 
analog produce data from the produce item into 
digital produce data. 

3. The produce recognition system according to claim 
1, wherein the sound circuitry is located on a 
mother board within the computer. 

4. The produce recognition system according to claim 
1, wherein the sound circuitry is located on an 
adapter board within the computer. 

5. The produce recognition system according to claim 
1, wherein the sound circuitry is located on a PC 
card within the computer. 

6. The produce recognition system according to any 
preceding claim, further comprising: 

an audio cable for coupling the sound circuitry 
to the produce data collector. 

7. The produce recognition system according to claim 
6, wherein the audio cable couples to a line input 
jack in the sound circuitry. 

8. The produce recognition system according to any 
preceding claim, wherein the sound circuitry com- 
prises at least one channel for processing the pro- 
duce data from the produce data collector. 

9. The produce recognition system according to any 
preceding claim, wherein the produce data collector 
comprises: 

a spectrometer. 

10. The produce recognition system according to any 
preceding claim, wherein the computer identifies 
the produce item by comparing the sampled pro- 
duce data to reference produce data. 

1 1. A produce recognition method comprising the steps 
of: 

(a) collecting analog produce data from a pro- 
duce item by a produce data collector; 

(b) converting the analog produce data into dig- 
ital produce data by an analog-to-digital con- 
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verter within sound circuitry controlled by a 
computer; and 

(c) identifying the produce item from the digital 
produce data by the computer. 

5 

12. The method according to claim 1 1 , further compris- 
ing the step of: 

(d) coupling the produce data collector to a line 
input jack coupled to the analog-to-digital con- 10 
verter using an audio cable. 

13. The method according to claims 11 or 12, wherein 
step (c) comprises the substep of: 



(c-1) comparing the digital produce data to ref- 
erence digital produce data. 
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